Adaptive backstepping repetitive learning control design for nonlinear discrete‐time systems with periodic uncertainties

This paper addresses a tracking problem for uncertain nonlinear discrete‐time systems in which the uncertainties, including parametric uncertainty and external disturbance, are periodic with known periodicity. Repetitive learning control (RLC) is an effective tool to deal with periodic unknown components. By using the backstepping procedures, an adaptive RLC law with periodic parameter estimation is designed. The overparameterization problem is overcome by postponing the parameter estimation to the last backstepping step, which could not be easily solved in robust adaptive control. It is shown that the proposed adaptive RLC law without overparameterization can guarantee the perfect tracking and boundedness of the states of the whole closed‐loop systems in presence of periodic uncertainties. In addition, the effectiveness of the developed controller is demonstrated by an implementation example on a single‐link flexible‐joint robot. Copyright © 2014 John Wiley & Sons, Ltd.     

Hybrid make-to-stock and make-to-order systems: a taxonomic review

Production planning and control (PPC) systems that employ aspects from both make-to-order (MTO) and make-to-stock (MTS) production control are known as hybrid MTS/MTO systems. While both MTO and MTS separately have been studied extensively, their combined use has received less attention. However, the literature on this topic is growing and this paper shows that the review performed in this paper is an important addition to the field. We categorise relevant literature according to a novel taxonomy and show that hybrid MTS/MTO production control can be used in different contexts. In addition, an overview of the modelling techniques and methods used in these papers is provided. Based on the reviewed literature, relevant research questions and directions for future research are identified. Finally, it is shown that hybrid MTS/MTO production control is prevalent in practice by discussing research with industrial applications. The paper contains an overview of research on hybrid MTS/MTO production control to be used as reference for researchers active in the field, and provides managerial insights and directions for future research on this topic.     

马尔可夫跳变线性系统最优控制的研究现状与进展

马尔可夫跳变线性系统（MJLS）是一种具有多个模态的随机系统，系统在各个模态之间的跳变转移由一组马尔可夫链来决定。MJLS模型因其在表示过程中可以产生突变而更能精确的描述实际工程应用中的系统。近年来，MJLS的最优控制问题成为了研究的热点，动态规划、极大值原理以及线性矩阵不等式等成为了解决此类问题的主流方法。本文对MJLS最优控制领域的研究现状进行了综述。分别对一般情况下、带有噪声的情况下、带有时滞的情况下以及某些特定情况下的MLJS最优控制问题的国内外研究现状进行论述。最后进行了总结并提出MJLS最优控制领域未来值得关注的研究方向。     

Nonuniform linear array DOA estimation using EM criterion

In this letter, we address the problem of Direction of Arrival (DOA) estimation with nonuniform linear array in the context of sparse Bayesian learning (SBL) framework. The nonuniform array output is deemed as an incomplete-data observation, and a hypothetical uniform linear array output is treated as an unavailable complete-data observation. Then the Expectation-Maximization (EM) criterion is directly utilized to iteratively maximize the expected value of the complete-data log likelihood under the posterior distribution of the latent variable. The novelties of the proposed method lie in its capability of interpolating the actual received data to a virtual uniform linear array, therefore extending the achievable array aperture. Simulation results manifests the superiority of the proposed method over off-the-shelf algorithms, specially on circumstances such as low SNR, insufficient snapshots, and spatially adjacent sources.     

The generalized discrete ‐centroid problem

The ‐centroid problem or leader–follower problem is generalized considering different customer choice rules where a customer may use facilities belonging to different firms, if the difference in travel distance (or time) is small enough. Assuming essential goods, some particular customer choice rules are analyzed. Linear programming formulations for the generalized ‐medianoid and ‐centroid problems are presented and an exact solution approach is applied. Some computational examples are included.     

When Does Communication Learning Need Hierarchical Multi-Agent Deep Reinforcement Learning

Abstract

Multi-agent systems need to communicate to coordinate a shared task. We show that a recurrent neural network (RNN) can learn a communication protocol for coordination, even if the actions to coordinate are performed steps after the communication phase. We show that a separation of tasks with different temporal scale is necessary for successful learning. We contribute a hierarchical deep reinforcement learning model for multi-agent systems that separates the communication and coordination task from the action picking through a hierarchical policy. We further on show, that a separation of concerns in communication is beneficial but not necessary. As a testbed, we propose the Dungeon Lever Game and we extend the Differentiable Inter-Agent Learning (DIAL) framework. We present and compare results from different model variations on the Dungeon Lever Game.     

On one boundary problem for nonlinear stationary controlled system

The object of study is nonlinear stationary controlled system of ordinary differential equations with constant disturbance in the right part. The problem of constructing the synthesising control function providing the transfer of this system from the initial state to the origin is considered. The sufficiently simple for numerical implementation algorithm of solution of the above-mentioned problem is obtained. It is shown that for local null controllability of the considered system, it is sufficient that the conditions of the Kalman's type were satisfied. In addition, the estimates restricting the choice of initial conditions and external disturbances under which the transfer is guaranteed are obtained. The main idea of the method of construction of the desired control function consists in reducing the original problem to stabilisation of a special kind linear non-stationary system and solving the Cauchy problem for an auxiliary system of ordinary differential equations closed by stabilising control. The simplicity of the realisation of this algorithm is determined by the construction of the auxiliary system and its stabilisation that could be obtained by analytical methods. The effectiveness of the method is illustrated by solving the problem of crane control and its numerical simulation.     

An energy-saving nonlinear position control strategy for electro-hydraulic servo systems

The electro-hydraulic servo system (EHSS) demonstrates numerous advantages in size and performance compared to other actuation methods. Oftentimes, its utilization in industrial and machinery settings is limited by its inferior efficiency. In this paper, a nonlinear backstepping control algorithm with an energy-saving approach is proposed for position control in the EHSS. To achieve improved efficiency, two control valves including a proportional directional valve (PDV) and a proportional relief valve (PRV) are used to achieve the control objectives. To design the control algorithm, the state space model equations of the system are transformed to their normal form and the control law through the PDV is designed using a backstepping approach for position tracking. Then, another nonlinear set of laws is derived to achieve energy-saving through the PRV input. This control design method, based on the normal form representation, imposes internal dynamics on the closed-loop system. The stability of the internal dynamics is analyzed in special cases of operation. Experimental results verify that both tracking and energy-saving objectives are satisfied for the closed-loop system.     

Delay compensated control of the Stefan problem and robustness to delay mismatch

This paper presents a control design for the one‐phase Stefan problem under actuator delay via a backstepping method. The Stefan problem represents a liquid‐solid phase change phenomenon which describes the time evolution of a material's temperature profile and the interface position. The actuator delay is modeled by a first‐order hyperbolic partial differential equation (PDE), resulting in a cascaded transport‐diffusion PDE system defined on a time‐varying spatial domain described by an ordinary differential equation (ODE). Two nonlinear backstepping transformations are utilized for the control design. The setpoint restriction is given to guarantee a physical constraint on the proposed controller for the melting process. This constraint ensures the exponential convergence of the moving interface to a setpoint and the exponential stability of the temperature equilibrium profile and the delayed controller in the norm. Furthermore, robustness analysis with respect to the delay mismatch between the plant and the controller is studied, which provides analogous results to the exact compensation by restricting the control gain.